Printing digital images using a print utilization file

ABSTRACT

An electronic printing system comprises a digital camera and a separate printing device for printing images captured by the digital camera. The digital camera comprises a sensor for capturing images, a memory for storing the captured images, a processor, and a communication interface. The processor produces a print utilization file based on user input regarding selection of particular ones of the captured images for printing by the separate printing device, and the print utilization file identifies at least two of the captured images to be printed by the printing device. The interface transmits the print utilization file and the selected captured images so as to permit printing of the selected captured images by the printing device.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This is a continuation of application Ser. No. 09/821,184, filed Mar.29, 2001, which is a continuation of application Ser. No. 08/977,382,filed Nov. 24, 1997, now U.S. Pat. No. 6,573,927, which claims priorityto provisional application Ser. No. 60/037,963, filed Feb. 20, 1997.

FIELD OF THE INVENTION

The invention relates generally to the field of photography, and inparticular to electronic photography. More specifically, the inventionrelates to an electronic camera that can be interfaced with a hostcomputer.

BACKGROUND OF THE INVENTION

Digital cameras, such as the Kodak Digital Science DC25™ camera, allowimages to be utilized on a home computer (PC) and to be incorporatedinto e-mail documents and personal home pages on the World Wide Web.Presently, if a print is desired, each image must first be copied to thePC and then individually printed. The user is required to manuallyselect each image to be printed, and manually decide how big each printshould be and how many prints to make of each image.

In addition, it is possible for users to electronically send images toothers using software, such as the Kodak Digital Science PicturePostcard Software™. However, this again requires the user to manuallydownload each image to the host computer, select each image to betransmitted, and create a new “Postcard” for each image to be sent.Users can also create “albums” of photos on their computers usingsoftware such as the Family Album Creator™ by Creative Wonders, Inc.Again, however, this is a manual process that requires each image to bedownloaded to the computer, individually selected, and added to thealbum.

In U.S. Pat. No. 5,241,659, reprint information can be generated at thetime a PhotoCD disc is played back. This patent describes an EEPROM cardthat can be inserted into a PhotoCD player. As shown in FIGS. 3, 5, and6 of this patent, the EEPROM card can contain reprint order informationand “album disc” information input by the player operator. However, thisinformation is not generated at the time of picture taking, and is notstored on the same media as the images. Moreover, the reprintinformation does not include information useful to the service provider,such as user account, charge card, and mailing address.

What is needed is a way for camera users to quickly and easily compose“print orders” and “transmission orders” and/or “electronic albuming”orders, at the time they capture their images.

SUMMARY OF THE INVENTION

Accordingly, it is an object of the present invention to provide anelectronic printing system for printing images stored in an internalmemory or on a removable memory card of a digital camera.

In accordance with one aspect of the invention, an electronic printingsystem comprises a digital camera and a separate printing device forprinting images captured by the digital camera. The digital cameracomprises a sensor for capturing images, a memory for storing thecaptured images, a processor, and a communication interface. Theprocessor produces a print utilization file based on user inputregarding selection of particular ones of the captured images forprinting by the separate printing device, and the print utilization fileidentifies at least two of the captured images to be printed by theprinting device. The interface transmits the print utilization file andthe selected captured images so as to permit printing of the selectedcaptured images by the printing device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of the system according to the invention;

FIG. 2 is a diagram of downstream services available in the system shownin FIG. 1;

FIG. 3 is an illustration of one example of a creative background addedto an image;

FIG. 4 is a diagram of the organization of a utilization file; and

FIG. 5 is a diagram of another organization of a utilization filetogether with each image file.

DETAILED DESCRIPTION OF THE INVENTION

Because imaging systems and devices are well known, the presentdescription will be directed in particular to elements forming part of,or cooperating more directly with, apparatus in accordance with thepresent invention. Elements not specifically shown or described hereinmay be selected from those known in the art. Some aspects of the presentdescription may be implemented in software. Unless otherwise specified,all software implementation is conventional and within the ordinaryskill in the programming arts.

A system block diagram of the invention is shown in FIG. 1, and includesa user's host computer (PC) 10, a digital camera 12, equipment locatedat a “downstream” service provider 14, and equipment at a walk-up kiosk16. The camera 12 includes an optical section 18 for imaging a sceneupon an image sensor 20 and generating an image signal, an A/D converter22 for digitizing the image signal, a liquid crystal display (LCDscreen) 24 for displaying images and other information, a number of userinput buttons 26, and both internal memory 32 and a removable memorycard 36 for storing captured images. The camera 12 may optionallyinclude an internal communications interface 28 (e.g., modem). Amicroprocessor 29 generally controls the operation of the camera 12, andinterchanges data through a memory card interface 34 with the memorycard 36, through a PC interface 38 with the host computer 10, through ahost interface 30 directly with the kiosk 16, and through thecommunications interface 28 and a communications network 31 with theservice provider 14.

When the camera 12 is purchased, it is provided with a softwareapplication (located on a disc 40) for running on the user's host PC 10that enables the user to specify the name(s) of downstream serviceproviders, network addresses (friends, family or business associates)and related account information such as billing information (e.g.,charge card number, mailing addresses). The user can also select,through the software application, one or more “creative backgrounds”offered by the service provider (such as a postcard border) and enterone or more text messages, (such as “Hi, I'm having a relaxing vacation,John Smith”), as will be described in connection with FIG. 3. All ofthis information can then be downloaded, via a memory card reader 42 onthe host PC 10, to the removable memory card 36, which can besubsequently inserted into the camera 12. Alternatively, the informationcan be downloaded to the camera 12 via the host PC interface 38 andwritten to the camera's internal memory 32 or the removable memory card36 in the camera. Typically, keyword descriptors accompany theinformation to enable easy access by the camera user.

After placing the memory card 36 in the camera 12 (or disconnecting thecamera 12 from the host PC 10), the user can operate the camera 12 totake numerous pictures, which are stored either in the internal memory32 or in the memory card 36 (or in both). After taking pictures, theuser reviews the images on the LCD screen 24, using the buttons 26 toscroll through the images. The user can then select the desired“downstream services” (printing, e-mailing, and/or albuming) and composethe order using the options listed in FIG. 2. These services and optionsare accessed from the memory card 36 and, for example, the keyworddescriptors are assembled in a menu and displayed on the LCD screen 24.Selections among these services and options are made, for example, byreference to the keyword descriptors and actuation of the user buttons26. The details of the order information is written into a “utilization”file generated by the camera 12 that identifies the order and includespointers to the image files that store the images required to “fulfill”the order. The “utilization” file is stored in the internal memory 32 orthe memory card 36.

For printing, order composition involves selecting the quantity, printsize, and quality level (e.g., thermal or ink jet) of the images to beprinted. For example, the user might choose one “standard” (4″×6″ size)image of 2 different images, and 2 standard size images plus one“enlargement” (8″×10″ size) image of their “favorite” vacation image.The print order information is provided in the utilization file thatidentifies the order and includes pointers to the image files that storethe images required to “fulfill” the print order. In addition to“normal” type prints, the prints can be “creative” prints, using one ofthe creative backgrounds selected on the host computer and downloaded tothe camera along with text. In this case, the “favorite” image might besurrounded with one of the border and captions provided via the host PC10, as shown in FIG. 3.

The user can then take or mail the image memory card 36 containing theimage files and order information (utilization file) to the printservice provider 14. The provider reads the information, fills the printorder, and returns the print order either for pick-up by the user or bymail. The service provider 14 charges the user's credit card account(which can be stored in the print order information file) for the printsprovided. Alternatively, the user can place the card 36 in a slot 50 ofa “walk-up kiosk” 16 along with a credit card. The kiosk can thenautomatically produce the prints required while minimizing the amount ofuser interaction required. Finally, the user could place the card in ahome printer 48, and the printer could automatically produce thequantity of prints of each image required. In the last two cases, thesize and quality of print types available might be limited to thoseavailable by the kiosk 16 or the home printer 48.

Alternatively, the camera 12 could incorporate or be connected to awired or wireless modem, such as the communications interface 28. Inthis case, the print order information, and the image information neededto fulfill the print order, would be transmitted to the service provider14 along with the account information through the communication network31 (which could be a wired or wireless network). The service provider 14would print the order and mail the prints back to the user.

Instead of, or in addition to, composing a print order, the user maychoose to transmit one or more images to others. These images caninclude the “creative” images and/or text described above. The userselects the images and the person(s) who will receive them, from thegroup of addresses loaded into the camera 12 via the process describedearlier (the software application running on the home PC 10). The e-mailorder information is provided in the utilization file that gives thee-mail address and includes pointers to the image files that store theimages required to “fulfill” the e-mail order.

If the camera 12 includes a transmitter, e.g., a cellular connection inthe communications interface 28, the camera 12 could include andinitiate a “send” command that the user would enable after completingthe e-mail order. This command would automatically send the appropriateimages to the appropriate user's e-mail accounts through the network 31using the appropriate communications protocol (i.e., FTP, mailto).Alternatively, the camera 12 can be placed in a docking unit (not shown)containing the modem. The images can then be automatically transmittedto the service provider 14, when the camera 12 is inserted into thedock. Alternatively, the memory card 36 could be removed from the camera12 and placed in a kiosk, which would then transmit the images and billthe user's charge card.

Instead of, or in addition to, composing a print order and/or an e-mailorder, the user may choose to transmit one or more images to their“electronic photo album” account, which could be maintained by theservice provider 14 (or alternatively could be maintained on the user'shome computer 10) in an image “album” storage 52. In this case, the userselects the images to be transferred to their photo album, andoptionally selects what group of users might be allowed to view theimages. The groups may include “Self only”, “Self plus immediate familyonly”, and “All” (i.e., family, friends) The information may includetext, which may be input and selected as described in U.S. Pat. No.5,633,678, “An Electronic Still Camera for Capturing and CategorizingImages”, filed Dec. 20, 1995, and assigned to the assignee of thepresent application, the disclosure of which is herein incorporated byreference.

Instead of having the camera 12 communicate directly to the “downstream”service provider 14 over the communications network 31, thecommunications network 31 from the camera 12 could alternatively beconnected to an internet service provider (ISP) (not shown) such as AOL(America On Line), Earthlink, and Eznet. The “downstream” serviceprovider 14 would then be connected to all ISPs via the internet,eliminating the need to maintain a separate communications network. TheISP would transfer the utilization file data and images needed to orderprints and album images to the downstream service provider. The ISPcould itself handle e-mailing of images to other users, using the dataand images in the utilization file.

The utilization order information is provided in the utilization file.The general file organization is shown in FIG. 4, and a detailed exampleof the file contents of an elaborate utilization file is given inAppendix I. This file may be encrypted to prevent unauthorized use ofthe sensitive information, such as the user's credit card number.Referring to Appendix I, a Global information section (lines 2-26)provides the customer information (name, address, credit card), as wellas the time the order was placed, and whether it has been processed ornot.

The file may contain one or more Print Order sections. For example,lines 28-37 describe a print order of “standard” size (4″×6″) prints ofthe images made on a silver halide based CRT printer. Line 34 indicatesthat two copies of the image referenced in line 33 will be printed,while only one copy of the images referenced in lines 35-36 is printed.A second print order section (lines 39-55) indicates a large size print(24″×36″) should be made on a silver halide printer and mounted inparticular in a walnut frame. This printer should be sent via UPS to theaddress shown in lines 47-52. The image is the composite shown in FIG.3, which is described in the CreativeDetail section (lines 76-90 ).

An e-mail order section (lines 57-65) provides the e-mail address and alist of images that should be sent to this address. An album ordersection (lines 67-72) provides a means for adding images to the userson-line photo album. The user can classify the images under a particularheading (e.g., “vacation” images) and indicate who is allowed to accessthe images via the internet.

A Creative Detail section (lines 74-90) defines each creative image,such as the image in FIG. 3. It also describes user defined text (line81). Multiple templates and user text options may be downloaded from thehost computer to a memory card 36 that is then inserted into the camera12, prior to taking pictures. The template (background) may be anidentification code that is only added, for example, during printing. Inthis case, the template is not viewed when the image is displayed on thecamera 12. Alternatively, a low resolution version of the templatesdesired by the user can be stored in the camera 12, so that the user canpreview the final composite image. A high resolution version of thetemplate can be used by the service provider to print the finalcomposite image. The user may decide to crop and rotate the image (lines86-87) prior to inserting it into the creative background.

Finally, an image detail section (92-102) describes the file type (e.g.,FlashPix, JPEG, TIFF) and location of each image. In this example, thethree images are all FlashPix images located on the memory card “LocalCard” in the “vacation” folder.

Most of the information in Globallnfo and CreativeDetail sections of thedigital camera utilization file, for example the addresses and creativetext, is downloaded from the host computer to the camera prior topicture taking. After reviewing the images, the user uses the image LCDand user interface to select which images to print, e-mail, and album.The print size, e-mail, albuming, and creative options are offered bypull-down menus that match the options provided by the service providersthey have selected on the computer and downloaded to the camera 12 (viathe memory card 36). The full utilization file (i.e., Print order,e-mail order) is then created by the camera based on the userselections.

A much simpler print utilization file is shown in Appendix II. In thiscase, the camera 12 simply allows a print order to be created. Thememory card 36 containing the images and the simple utilization file isthen inserted into the home PC 10, the home printer, or the walk-upkiosk 16 or sent to a service provider via a communications interface.The proper number of each selected image is then automatically printed,without further user intervention.

Instead of providing the utilization information for multiple images ina single utilization file, other embodiments are possible. For example,the camera may create three utilization files, one containing theinformation needed to produce a print order, a second containinginformation needed to provide electronic albuming, and a thirdcontaining e-mail order information.

Alternatively, the utilization information may be provided with eachimage file, as shown in FIG. 5. In this embodiment, the print orderinformation describing the number and size of each image to be printedis included in tags provided within each image file. For example, imagefile #1 contains the image data and a tag indicating that the user hasrequested one standard size print. Image file #2 does not contain aprint tag (or alternatively could include a tag with the number ofprints set equal to zero) so no prints will be made of image #2. Imagefile #3 includes a first print tag indicating that the user hasrequested two standard size prints, and a second tag indicating that theuser has also requested a single 8″×10″ size enlargement.

The invention has been described with reference to a preferredembodiment. However, it will be appreciated that variations andmodifications can be effected by a person of ordinary skill in the artwithout departing from the scope of the invention. APPENDIX I DIGITALCAMERA UTILIZATION FILE  1 00000000 UTILIZATION ORDER SPECIFICATION(Non-zero initial number identifies encryption key)  2 %Section:GlobalInfo  3 %Section: ConsumerInfo (Provides info on camera owner anddefault mailing address)  4 %Name: ˜Smith˜˜John˜˜W˜  5 %Consumer ID:Njj1007  6 %Address: ˜1 Picture Avenue˜  7 ˜Apartment 8b˜  8 ˜PO Box123˜  9 ˜Anytown˜  10 ˜State˜  11 %PostalCode:˜14650˜  12%CountryCode:USA  13 %Email:˜jdoe@kodak.com˜  14 %PhoneDay: ˜(716)555-1111˜  15 %PhoneNight: ˜(716) 555-2222˜  16 %CreditCardExpDate: 199603 24  17 %CreditCardNumber: 3030445643345  18 %CreditCardType:AmericanExpress  19 %EndSection: ConsumerInfo  20  21 %Section:OrderInfo (Provides information on when utilization file was created) 22 %Date: 1996 2 28  23 %Time: 14 22 29  24 %Processed: 0 (1 Indicatesthat this utilization order was processed)  25 %EndSection: OrderInfo 26 %EndSection: GlobalInfo  27  28 %Section: PrintOrder (Lists theimages in a print order)  29 %Section: FinishInfo  30 %ImageOutputSize:4 6 Inches (This example is for standard size prints)  31 %MediaClass:AgX 20 EN34 Glossy  32 %EndSection: FinishInfo  33 %ImageRef:ImageDetail1 (Points to images defined below)  34 %Quantity:2(Optionally indicates number of copies, default=1)  35 %ImageRef:ImageDetail2  36 %ImageRef: ImageDetail3  37 %EndSection: PrintOrder  38 39 %Section: PrintOrder  40 %Section: FinishInfo  41 %ImageOutputSize:24 36 Inches (This example is for a large creative print)  42%MediaClass: AgX 20 EN34 Glossy  43 %FrameType: F134 Walnut  44%EndSection: FinishInfo  45 %Section: ShippingInfo (Instructions to shipto an address other than the one in GlobalInfo)  46 %ShippingCarrier:UPS  47 %Name: ˜Good˜˜Johnny˜˜B˜  48 %Address: ˜1 Song Street˜  49˜Mytown˜  50 ˜State˜  51 %PostalCode: ˜00111˜  52 %CountryCode: USA  53%EndSection: ShippingInfo  54 %ImageRef: CreativeDetail1 (Points tocreative defined below)  55 %EndSection: PrintOrder  56  57 %Section:EmailOrder (Sends images via e-mail)  58 %Section: AddressInfo(Instructions to ship to an address other than the one in GlobalInfo) 59 %Narne: ˜Good˜˜Johnny˜˜B˜  60 %Email: ˜jgood@localnet.net˜  61%EndSection: AddressInfo  62 %ImageRef: Creative Detail1 (Points tocreative defined below)  63 %ImageRef: ImageDetail2  64 %ImageRef:ImageDetail3  65 %EndSection: EmailOrder  66  67 %Section: AlbumOrder(Add these images to on-line photo album)  68 %AlbumHeading: ˜Vacationimages˜ (Place images under “vacation” album heading)  69 %AlbumViewing:All (gives access to all authorized album viewers)  70 %ImageRef:CreativeDetail1 (Points to creative defined below)  71 %ImageRef:ImageDetail2  72 %EndSection: AlbumOrder  73  74 %Section:CreativeDetail 1 (Describes each composite image)  75  76 %LayoutRef:T12345 (Indicates template ID or template image file)  77 %Section:PageInfo  78 %PageRef: 0  79 %Section: TextInfo (Indicates what textappears in the template)  80 %TextNodeRef: 1  81 %ConsumerText: ˜Hi, I'mhaving a relaxing time on vacation. John Smith  82 %EndSection: TextInfo 83 %Section:Imagelnfo (Indicates which images(s) appear in template) 84 %ImageNodeRef: 2  85 %ImageDetailRef: 1  86 %CropRect: 256 0 7681280 (Cropped image top, left, width, height)  87 %Rotate: 90 (Indicatesrotation in degrees clockwise)  88 %EndSection: ImageInfo  89%EndSection: PageInfo  90 %EndSection: CreativeDetail  91  92 %Section:ImageData (Describes each image, may be referenced multiple times)  93%Section: ImageDetail 1  94 %FileType: FlashPix Version 2.0  95%ImageLocation: LocalCard˜Vacation/Image4.FPX˜  96 %Section: ImageDetail2  97 %FileType: Flashpix Version 2.0  98 %ImageLocation:LocalCard˜Vacation/Image7.FPX˜  99 %Section: ImageDetail 3 100%FileType: FlashPix Version 2.0 101 %ImageLocation:LocalCard˜Vacation/Image10.FPX˜ 102 %EndSection: ImageData

APPENDIX II SIMPLE PRINT ORDER UTILIZATION FILE 1 %Section: PrintOrder(Lists the images in a print order) 2 Image4.FPX 1 (One copy of image 4)3 Image7.FPX 2 (Two copies of image 7) 4 Image10.FPX 1 5 Image12.FPX 4 6Image13.FPX 1 7 %EndSection: PrintOrder

1. A digital camera for capturing images that can be printed by aseparate printing device, the digital camera comprising: a sensor forcapturing images; a memory for storing the captured images; a processorfor producing a print utilization file based on user input regardingselection of particular ones of the captured images for printing by theseparate printing device, the print utilization file identifying atleast two of the captured images to be printed by the printing device;and a communication interface for transmitting the print utilizationfile and the selected captured images so as to permit printing of theselected captured images by the printing device.
 2. The camera asclaimed in claim 1 wherein the memory comprises at least one of aninternal memory of the camera and a removable memory card of the camera.3. The camera as claimed in claim 1 wherein the separate printing devicecomprises a printer which is coupled to the camera via the interface. 4.The camera as claimed in claim 1 wherein the separate printing devicecomprises a computer configured to communicate with the camera via theinterface.
 5. The camera as claimed in claim 1 wherein the separateprinting device comprises a service provider configured to communicatewith the camera via the interface.
 6. The camera as claimed in claim 1wherein the separate printing device comprises a kiosk configured tocommunicate with the camera via the interface.
 7. The camera as claimedin claim 1 wherein the interface comprises a wired interface.
 8. Thecamera as claimed in claim 1 wherein the interface comprises a wirelessinterface.
 9. The camera as claimed in claim 1 wherein the printutilization file further indicates the quantity of prints to be printedfor each of the selected images.
 10. The camera as claimed in claim 1wherein the print utilization file further indicates the size of theprints to be printed for each of the selected images.
 11. The camera asclaimed in claim 1 wherein the print utilization file further includes aname and mailing address of an owner of the camera.
 12. The camera asclaimed in claim 1 wherein the print utilization file further includes acredit card number.
 13. The camera as claimed in claim 1 wherein theprint utilization file further indicates a particular creativebackground to be utilized in printing at least one of the selectedimages.
 14. An electronic printing system comprising: a digital camera;and a separate printing device for printing images captured by thedigital camera; the digital camera comprising: a sensor for capturingimages; a memory for storing the captured images; a processor forproducing a print utilization file based on user input regardingselection of particular ones of the captured images for printing by theseparate printing device, the print utilization file identifying atleast two of the captured images to be printed by the printing device;and a communication interface for transmitting the print utilizationfile and the selected captured images so as to permit printing of theselected captured images by the printing device.
 15. The printing systemas claimed in claim 14 wherein the separate printing device comprises aprinter which is coupled to the camera via the interface.
 16. Theprinting system as claimed in claim 14 wherein the separate printingdevice comprises a computer configured to communicate with the cameravia the interface.
 17. The printing system as claimed in claim 14wherein the separate printing device comprises a service providerconfigured to communicate with the camera via the interface.
 18. Theprinting system as claimed in claim 14 wherein the separate printingdevice comprises a kiosk configured to communicate with the camera viathe interface.
 19. A method for use in a digital camera for capturingand selecting images to be printed by a separate printing device, themethod comprising the steps of: storing a plurality of captured images;producing a print utilization file based on user input regardingselection of particular ones of the captured images for printing by theseparate printing device, the print utilization file identifying atleast two of the captured images to be printed by the printing device;and transmitting the print utilization file and the selected capturedimages so as to permit printing of the selected captured images by theprinting device.
 20. The method as claimed in claim 19 wherein thetransmitting step further comprises transmitting the print utilizationfile and the associated captured images to a computer having anassociated printer.